Remote cine viewing of medical images on a zero-client application

ABSTRACT

Systems and methods for remotely viewing medical images on a client device having a zero-client web application with a buffering module. The zero-client web application receives an image series selection from a user and receives corresponding series details from a web server. The zero-client web application generates an off-screen image array according to the series details. The buffering module outputs image requests based on the series details to a web server. The web server is in communication with a medical image database storing images in a non-web browser compatible format (e.g., DICOM). The buffering module then populates the off-screen image array with converted medical images received from the web server. The zero-client web application further includes an on-screen image and a display module. The display module sequentially sets converted medical images of the off-screen array as the on-screen image to stream the converted medical images.

RELATED APPLICATIONS

This application is a continuation of patent application Ser. No.15/146,536, filed May 4, 2016, which is a continuation of patentapplication Ser. No. 14/333,280, filed Jul. 16, 2014, now U.S. Pat. No.9,338,207, which is a continuation of patent application serial number13/305,442 filed Nov. 28, 2011, now U.S. Pat. No. 8,799,358, the entirecontents of all of which are hereby incorporated by reference.

FIELD OF THE INVENTION

The present invention relates to remote cine viewing of medical images.

SUMMARY

In some embodiments, the invention provides a method of viewing medicalimages on a remote device using a zero-client web application. Themethod includes receiving, from a user, an image series selection viathe zero-client web application and establishing a connection betweenthe zero-client web application and a web server. The web applicationfurther receives series details from the web server and generates anoff-screen image array according to the series data. Based on the seriesdetails, a buffering module outputs image requests to the web server,which is in communication with a medical image database storing imagesin a non-web browser compatible format. The zero-client web applicationreceives, from the web server, converted medical images in response tothe image requests. The converted medical images are in a web browsercompatible format. The buffering module populates the off-screen imagearray with the converted medical images received from the web server. Adisplay module sets a first converted medical image within theoff-screen image array as an on-screen image to display the firstconverted medical image. Thereafter, the display module sets a nextconverted medical image from the off-screen image array as the on-screenimage to display the next converted medical image in place of the firstconverted medical image. The display module then sequentially setssubsequent converted medical images of the off-screen image array as theon-screen image to stream the converted medical images.

In some embodiments, the invention provides a client device for remotelyviewing medical images. The client device includes a zero-client webapplication, a communication interface, a buffering module, a memory,and a display module. The communication interface enables communicationsbetween the zero-client web application and a web server. Thezero-client web application receives, from a user, an image seriesselection and receives, from the web server, series detailscorresponding to the image series selection. The zero-client webapplication further generates an off-screen image array according to theseries details. The buffering module outputs image requests based on theimage series selection to the web server, which is in communication witha medical image database storing images in a non-web browser compatibleformat. The memory stores the off-screen image array generated by thezero-client web application. The buffering module populates theoff-screen image array with the converted medical images received fromthe web server in response to the image requests. The converted medicalimages are in a web browser compatible format. The display module sets afirst converted medical image within the off-screen image array as anon-screen image to display the first converted medical image.Thereafter, the display module sets a next converted medical image fromthe off-screen image array as the on-screen image to display the nextconverted medical image in place of the first converted medical image.The display module then sequentially sets subsequent converted medicalimages of the off-screen array as the on-screen image to stream theconverted medical images.

In some embodiments, the invention provides a computer readable mediumincluding computer executable instructions that, when executed by aprocessor of a client device, generate a zero-client web applicationthat enables remote viewing of medical images. The zero-client webapplication receives, from a user, an image series selection via thezero-client web application and establishes a connection between thezero-client web application and a web server. The zero-client webapplication further receives series details from the web server andgenerates an off-screen image array according to the series details. Thezero-client web application includes a buffering module that outputs,based on the series details, image requests to the web server, which isin communication with a medical image database storing images in anon-web browser compatible format. The zero-client web applicationreceives from the web server, converted medical images in response tothe image requests. The converted medical images are in a web browsercompatible format. The buffering module populates the off-screen imagearray with the converted medical images received from the web server.The zero-client web application also sets a first converted medicalimage within the off-screen image array as an on-screen image to displaythe first converted medical image, sets a next converted medical imagefrom the off-screen image array as the on-screen image to display thenext converted medical image in place of the first converted medicalimage; and sequentially sets subsequent converted medical images of theoff-screen image array as the on-screen image to stream the convertedmedical images.

Other aspects of the invention will become apparent by consideration ofthe detailed description and accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts a system for remote viewing of medical images using azero-client web application.

FIGS. 2-3 depict a graphical user interface of a zero-client webapplication.

FIGS. 4A-F depict a process for remote cine viewing of medical imagesaccording to embodiments of the invention.

FIG. 5 depicts a method of streaming remotely stored images on azero-client web application according to embodiments of the invention.

FIG. 6 depicts a method for determining a frame playback rate.

FIG. 7 depicts a method for handling a request from a zero-client webapplication for medical images stored in an incompatible format.

DETAILED DESCRIPTION

Before any embodiments of the invention are explained in detail, it isto be understood that the invention is not limited in its application tothe details of construction and the arrangement of components set forthin the following description or illustrated in the following drawings.The invention is capable of other embodiments and of being practiced orof being carried out in various ways. Additionally, although steps ofmethods are described herein as being executed in a particular order, insome instances, these steps may be executed in another order,simultaneously, and/or partially simultaneously.

In a client-server architecture, various functions are carried out bythe client, and other functions are carried out by the server. The morefunctions performed by the client, rather than the server, the “thicker”the client. In contrast, the more functions performed by the server,rather than the client, the “thinner” the client. Accordingly, a thickclient web application is an application executed by a web browser of aclient device that typically provides extensive functionalityindependent of a central server. Thick client web applications consumecomputer resources and use operating system capabilities of the clientdevice's operating system and installed libraries beyond thecapabilities of a standard web browser. A thick client web applicationcan, for instance, receive data (e.g., images) in a raw or intermediatestate and process the data locally on the client device with lessreliance on processing at the server. A thick client may also bereferred to as a fat client, a heavy client, and a rich client. Incontrast, a thin client web application executing on a client devicerelies on the processing power of the server. Thus, a thin client webapplication uses fewer computer resources and operating systemcapabilities of the client device than a thick client web applicationand typically uses a browser plugin or addon. A thin client webapplication uses, for instance, ActiveX, Flash, or Silverlight pluginswhere the plugin must exist on the client device or be installed beforethe web application can be used.

A zero-client web application is a web application that does not use webbrowser plug-ins or add-ons to extend the functionality of the core webbrowser program. Embodiments of the invention allow for remote cineviewing of medical images on a client device with a zero-client webapplication. In the context of this application, a zero-client webapplication means a web application executing in a standard web browserwithout browser plug-ins or add-ons for performing the remote imageviewing functions described herein. In other words, a user of the clientdevice does not need to install specialized plug-ins or add-ons to carryout the remote image viewing described in this application. The core webbrowser has sufficient processing capabilities to display and streammedical images that are compatible, such as Portable Network Graphics(PNG) or Joint Photographic Experts Group (JPEG) images, and the serverperforms the remaining image processing functions to render medicalimages in a format appropriate for the zero-client web application fordisplay or streaming without plug-ins or add-ons. A zero-client webapplication is, for instance, HyperText Markup Language (HTML) andJavaScript code stored on a web server and downloaded and executed by aweb browser.

FIG. 1 depicts a system 100 including a client device 105 with a webbrowser 106 that is executing a zero-client web application 110. Thezero-client web application 110 is in communication with a web server115 via a connection 117 over a network 120. The network 120 is one ormore of the Internet, a local area network (LAN), a wide area network(WAN), and other computer networks. The client device 105 and web server115 are coupled to the network 120 directly or indirectly by way of,e.g., a hub, router, or similar device. Such couplings include wiredconnections (universal serial bus (USB), Ethernet, etc.), wirelessconnections (e.g., Bluetooth, WiFi, cellular, etc.) or a combinationthereof. The zero-client web application 110 may be stored on the webserver 115 and a copy is transmitted to the web browser 106 in responseto the user navigating the web browser 106 to a web site 140 generatedby the web server 115. Thereafter, the web browser 106 executes thezero-client web application 110, as described in greater detail below.

The web server 115 is further in communication with an image server 125via the network 120. The image server 125 stores medical images in animage database 130 generated by the medical imager 135. The medicalimager 135 is one of a radiology imager, magnetic resonance imaging(MM), computer tomography (CT) scan device, ultrasound device,thermo-graphic imaging device, or another imaging device that generatesa medical image in a digital form. The image server 125 is incommunication with the medical imager 135 via the network 120, eitherdirectly or via one or more intermediate systems that may be used in thecommunication of medical images. The images within the image database130 include computed tomography (CT scan) images, magnetic resonanceimaging (MRI) images, x-ray images, and other graphical depictions ofpatient medical information.

Although shown as connected through the network 120, in some instances,one or more of the client device 105, web server 115, image server 125,and medical imager 135 are directly coupled (e.g., via a wiredconnection or direct wireless connection) or coupled via independentnetworks. For instance, the client device 105 may be coupled to the webserver 115 via the Internet, while the web server 115 and image server125 are coupled via an independent local area network (LAN), and theimage server 125 and medical imager 135 are directly coupled.

The client device 105 is one of a personal computer, kiosk, tablet,laptop, mobile phone device (e.g., an iPhone®, Blackberry®, Droid®,etc.), or other computing device with an ability to connect to thenetwork 120 and run the browser 106 to execute the zero-client webapplication 110. The client device 105 includes a processor thatexecutes the browser 106, zero-client web application 110, and othersoftware stored in a memory associated with the client device 105. Insome embodiments, one or more of the software programs are storedremotely from the client device 105. The zero-client web application 110may be stored on a computer readable medium, such as a hard disk,compact disc, flash drive, or other non-transitory, tangible computerreadable medium. Additionally, although the zero-client web application110 is described herein as software executed by a processor of theclient device 105, in some instances, the zero-client web application110 and other software are implemented partially or completely inhardware (e.g., using a field programmable gate array (FPGA) orapplication specific integrated circuit (ASIC)).

The client device 105 further includes a power source, a display (e.g.,a touch screen display), user inputs (e.g., push buttons, scroll wheels,a keyboard, a mouse, a microphone), user outputs (e.g. speakers), and anetwork communications interface for interfacing with the network 120.The power source is, for instance, a battery that provides power to thecomponents of the client device 105. In some instances, the power sourcereceives power from an external battery, wall outlet, or other externalpower source, and provides the power to components of the client device105.

The zero-client web application 110 provides a graphical user interface(GUI) on the display of the client device 105. The GUI enables the userto interact with the zero-client web application 110 by way of thedisplay, user input, audio in/out, etc.

FIG. 2 illustrates an exemplary GUI 150 of the zero-client webapplication 110. The GUI 150 is generated by the zero-client webapplication 110 in response to receiving data from the web site 140. TheGUI 150 includes navigation tools 155, a search tool 160, a series list165, and a preview window 170. The search tool 160 enables a user toenter keywords, patient identifiers, and other search parameters tolocate and identify images in the image database 130. Medical imageswithin the image database 130 may be grouped together to form an imageseries. For example, a CT scan may result in a sequence of images thatform an image series.

The series list 165 includes a list of image series including series 1,series 2, series 3, and series 4, each of which includes one or moremedical images associated with an example patient identifier “patient1234.” The series list 165 may include the series most recently viewedby the user, the results of a search performed using the search tool160, or other series. A thumbnail 175 representative of a highlightedseries within series list 165 is shown in the preview window 170. A usercan highlight a series by hovering a mouse over the series, clicking onthe series with a mouse, or selecting the series via a touch screendisplay, among other I/O techniques.

By selecting the view button 180, double clicking on a series withinseries list 165, or using another I/O technique, the GUI 150 is updatedas shown in FIG. 3. The GUI 150 of FIG. 3 includes series information185, a frame rate selector 190, and a series player 200 including adisplay window 205 and player controls 210. The series information 185lists details of the series selected as described above with respect toFIG. 2. The series information 185 includes a patient identifier (i.e.,patient 1234), which may be the patient's name, patient identificationnumber, or another unique identifier. The series information 185 mayalso include the date that the study was created (e.g., the date of a CTscan), a description of the study (e.g., neural MRI scan, kidneyultrasound, etc.), additional patient information (e.g., age, previousdiagnoses), previous notes made by medical staff regarding the patientor the series, and other information.

The user interacts with the player controls 210 to start, pause, skip,and restart the playing of a series of images in the display window 205.A slider 212 along timeline 213 indicates the elapsed time of the imageseries playback. The user may also drag the slider 212 to adjust theimage being displayed in the display 205. The frame rate selector 190enables a user to specify the playback frame rate for the series in theseries player 200. The user may specify one of a set of predeterminedframe rate options, or specify a particular frame rate. In someembodiments, a frame rate slider is included in the frame rate selector190 that enables a user to specify a frame rate by sliding a scroll leftand right or up and down to increase/decrease the frame rate. Other userI/O techniques are also contemplated for specifying the frame rate,including touch screen actions and voice commands. As will be describedin further detail below, the images of a series are sequentially sent bythe web server 115 to the client device 105. When the series player 200begins to play a series, a portion of the images of a series may stillbe in transit from the web server 115. The images of the series thathave been received, however, may be streamed by the series player 200 asthe additional images continue to be received.

FIGS. 4A-F illustrate a process 300 for remote viewing of medical imagesaccording to embodiments of the invention. Initially, a user requests animage series via the GUI 150 of the zero-client web application 110, forexample, by selecting an image series as described in FIG. 2 to proceedto the screen illustrated in FIG. 3. The GUI 150 generates an imageseries request 305 and provides the image series request 305 to aninitial request module 310. The initial request module 310 generates ahypertext transfer protocol (HTTP) request 315 including a UniformResource Locator (URL) with dynamically generated query parameters thatdescribe the image series requested. The initial request module 310 thentransmits the HTTP request 315 to an HTTP request handler 325 of the webserver 115.

The HTTP request handler 325 translates the HTTP request 315 to a seriesload request 330 for an image rendering module 335. The HTTP requesthandler 325 also generates a Digital Imaging and Communications inMedicine (DICOM) request 340 based on the series load request 330. TheDICOM request 340 is sent to the image database 130, which includesmedical images in a DICOM format or another format generallyincompatible with web browsers lacking particular add-ons or plug-ins.

Turning to FIG. 4B, the image database 130 returns DICOM image 345, tothe image rendering module 335 in response to the DICOM request 340. Theimage rendering module 335 receives additional information for therequested image series (series details 355). The series details 355indicates the number of frames associated with the series specified inthe image series request 305 and includes image frame information usedby the zero-client web application 110 to dynamically generate a URL foreach frame. Each URL may point to a single-frame DICOM image or maypoint to a single frame within a multi-frame DICOM image.

The HTTP request handler 325 forwards the series details 355 to theinitial request module 310. Upon receipt, the initial request module 310stores the series details 355 in a memory (not shown) of the clientdevice 105.

Turning to FIG. 4C, the initial request module 310 detects the currentdisplay settings of the display window 205. The display settings includethe size of the display window 205 (e.g., 1200×1400 pixels). The initialrequest module 310 generates a Uniform Resource Locator (URL) 360 withdynamically generated query parameters that specify the first image ofthe requested image series and describe the image view requested.Further, the zero-client web application 110 sets the “src” attribute ofan on-screen image 365 to the URL 360 to cause the zero-client webapplication 110 to generate an HTTP image request 362 to request thefirst image of the requested image series. The zero-client webapplication 110 then transmits the HTTP request 362 to an HTTP requesthandler 325 of the web server 115.

The HTTP request handler 325 translates the HTTP request 362 to a viewrequest 363 for an image rendering module 335. The HTTP request handler325 recognizes that the first DICOM image 345 was received by the webserver 115 in response to the earlier DICOM image request 340 and doesnot re-send the request to the image server 125.

As shown in FIG. 4D, the image rendering module 335 converts the DICOMimage 345 into a web browser compatible image 370. The web browsercompatible image 370 is generated according to the display settings ofthe view request 363. For instance, the web browser compatible image 370is sized according to the display settings. The web browser compatibleimage 370 is, for instance, a JPEG or PNG formatted image, which isdisplayable by the zero-client web application 110 and browser 106without specialized plug-ins or add-ons.

The HTTP request handler 325 forwards the web browser compatible image370 to the zero-client web application 110. Upon receipt by thezero-client web application 110, the web browser compatible image 370 isset to the on-screen image 365 and is visible to the user in the display205.

To begin a cine playback of the requested image series, the user selectsthe play button of player controls 210. Turning to FIG. 4E, the GUI 150outputs a play request 375, including the series details 355, to abuffering module 385 and a cine display module 387. In some instances,the zero-client web application 110 automatically generates the playrequest 375 without user input via GUI 150 after the first frame of therequested series (web browser compatible image 370) is displayed via theon-screen image 365.

Once the play request 375 is received by the buffering module 385, thebuffering module 385 generates an array of off-screen images 380, whichmay be stored in a memory (not shown) of the client device 105. Thearray of off-screen images 380 includes one element for each frame ofthe requested image series, as indicated by the series details 355. Eachelement of the array of off-screen images 380 includes a “src” attributethat is initially set to an empty value. Additionally, in contrast tothe on-screen image 365, each element of the array of off-screen images380 is not visible to a user of the zero-client web application 110.

After creation of the array of off-screen images 380, the bufferingmodule 385 begins setting the “src” attribute of each element of thearray of off-screen images 380 to a URL 390 representing an image frameview. Setting each “src” attribute to one of the URLs 390 causes thezero-client web application 110 to generate HTTP requests 395 to requesteach image frame of the requested image series. The zero-client webapplication 110 then transmits each HTTP image request 395 to the HTTPrequest handler 325 of the web server 125. The buffering module 385 willset the “src” attributes in a controlled manner such that a limitednumber of requests are outstanding at any given time.

The HTTP request handler 325 translates each HTTP request 395 to a viewrequest 400 for the image rendering module 335. The HTTP request handler325 also generates a DICOM request 405 based on the URL for each HTTPimage request 395 and sends each DICOM request 405 to the image database130.

Turning to FIG. 4F, the image database 130 returns a DICOM image 410 (ora frame thereof for multi-frame DICOM images) for each DICOM request 405to the image rendering module 335. The image rendering module 335converts each DICOM image 410 into a web browser compatible image 415.Each web browser compatible image 415 is generated according to thedisplay settings of its corresponding view request 400. The web browsercompatible images 415 are, for instance, JPEG or PNG formatted images,which are displayable by the zero-client web application 110 and browser106 without specialized plug-ins or add-ons.

The HTTP request handler 325 forwards the web browser compatible images415 to the zero-client web application 110, which sequentially storeseach web browser compatible image 415 in the array off-screen images380, one web browser compatible image 415 per element of the array ofoff-screen images 380.

Although the images 415 are described as being stored in the array ofoff-screen images 380, the images may be stored in a local client memoryand the web browser 106 or web application 110 construes the URLs withinthe elements of the array of off-screen images 380 as pointing to theirrespective images 415 in the local client memory. Additionally, thelocally stored web browser compatible images 415 may be generallyinaccessible to a user via a folder structure of an operating systemGUI. That is, a user cannot navigate through an operating system GUI toa folder storing temporary Internet/web browser files to locate the webbrowser compatible images 415. By preventing such access to users, theretrieved medical images are secured and the zero-client web application110 complies with certain government regulations related to patientprivacy. In some instances, the array of off-screen images 380 isdeleted upon closing of the browser 106, navigating away from the website 140 using the web browser 106, or after a predetermined amount oftime of user inactivity at the web browser 106. Accordingly, anotheruser without authorization to view the medical images is not able tolater retrieve and view them.

As the web browser compatible images 415 are received by the zero-clientweb application 110, the cine display module 387 begins streaming theweb browser compatible images 415. To stream the web browser compatibleimages 415, the cine display module 387 sends a URL request 420 to thearray of off-screen images 380 to request the “src” attribute of thesecond element (i+1) of the array of off-screen images 380. The array ofoff-screen images 380 returns a URL address 425 for the second elementof the array. The cine display module 387 replaces the “src” attributeof the on-screen image 365 with the retrieved URL 425. Accordingly, theon-screen image 365 will point to a location of memory storing the webbrowser compatible image 415 associated with the second element (i+1) ofarray 380, which is then retrieved and displayed by the zero-client webapplication 110 in the display 205. The “src” attribute of the on-screenimage 365 is then updated with the “src” attribute of the remainingelements of the array of off-screen images 380 (i.e., elements i+2, i+3,etc.), one-by-one in sequence, to stream the web browser compatibleimages 415.

FIG. 5 illustrates a method 450 of streaming remotely stored images on azero-client web application according to embodiments of the invention.In step 455, the zero-client web application 110 receives a user requestfor an image series via the GUI 150. In step 460, the zero-client webapplication 110 outputs an HTTP series request 315 to the web server115. In step 462, the zero-client web application 110 receives theseries details 355. In step 464, the initial request module 310determines the viewer parameters for the display window 205, such as thewindow size, image quality, and the user-selected frame rate forplayback. In step 466, the zero-client web application 110 outputs anHTTP image request 362 to the web server 115. In step 468 thezero-client application 110 receives the web browser compatible image370, which is displayed in the display window 205.

In step 470, the zero-client web application 110 creates the array ofoff-screen images 380 according to the series details 355. In step 475,the zero-client web application 110 generates and outputs the HTTP imagerequests 395 to web server 115. In step 480, the zero-client webapplication 110 populates the array of off-screen images 380 with webbrowser compatible images 415 received from the web server 115. Thezero-client web application 110 continues to populate the array ofoff-screen images 380 until the transfer of web browser compatibleimages 415 is completed; however, the zero-client web application 110simultaneously proceeds through the remaining steps of method 450.

In step 485, the zero-client web application 110 performs a calibrationstep to determine a sustainable frame rate based on the averagebandwidth detected for the connection 117 between the application 110and the web server 115. The sustainable frame rate is the rate at whicha series of images may be streamed from the web server 115 to thedisplay window 205 of the zero-client web application 110 withoutstalling to wait for receipt of further images. For instance, if thezero-client web application 110 is receiving images at a frame rate often frames/second from the web server 115, the application 110 can playback the images at a frame rate of ten images/second or less withoutstalling. In one embodiment, the zero-client web application 110determines the amount of time elapsed to download a first predeterminedamount of web browser compatible images 415 (i.e., frames) to determinethe sustainable frame rate. For instance, if the first ten images taketwo seconds to download, the sustainable frame rate is fiveframes/second.

In step 490, the zero-client web application 110 determines the framerate for playback. Step 490 is illustrated in greater detail in FIG. 6.In step 490 a, the cine display module 387 determines whether thebuffering module 385 is still receiving web browser compatible images415 from the web server 115 for playback on the display 205 (i.e.,whether the buffering module 385 is still buffering). If the bufferingmodule 385 is still buffering, as will likely be the situation as thefirst image is about to be displayed, the cine display module 387proceeds to step 490 b. In step 490 b, the cine display moduledetermines whether the user-selected frame rate is less than 75% of thesustainable frame rate determined by calibration in step 470. If theuser-selected frame rate is less than 75% of the sustainable frame rate,the cine display module 387 sets the playback frame rate to theuser-selected frame rate (step 490 c). If, however, the user-selectedframe rate is greater than or equal to 75% of the sustainable framerate, the cine display module 387 sets the playback frame rate to 75% ofthe sustainable frame rate (step 490 d). By selecting the lower of thetwo frame rates, the cine display module 387 improves the likelihoodthat the playback of the requested image series will not be stalled inthe display 205. If buffering is complete, as determined in step 490 a,all of the requested web browser compatible images 415 are storedlocally in the array of off-screen images 380. Accordingly, the cinedisplay module 387 sets the playback frame rate to the user selectedframe rate, as the risk of stalling due to the bandwidth of connection117 no longer exists. Although 75% of the sustainable rate is used as athreshold in step 490 b and a playback rate in 490 d of FIG. 6, in someinstances, other thresholds and playback rates are used (e.g., 50%, 90%,or 100%).

Returning to FIG. 5, in step 495, the cine display module 387 determineswhether additional images are within the array of off-screen images 380.If additional images are present, in step 495, the cine display module387 obtains the “src” attribute of the next image within the array ofoff-screen images 380. Continuing in step 497, the cine display module387 sets the “src” attribute of the on-screen image 365 to the “src”attribute of the next image, causing the next image to be displayed inthe display window 205. Step 497 is executed at a time that isappropriate to reach the desired frame rate as determined in step 490.For instance, to achieve 25 frames/second, step 497 is executed 1/25seconds after the previous setting of the “src” attribute of theon-screen image 365. Steps 490, 495, and 497 are repeated until the lastimage of the web browser compatible images 415 within the array ofoff-screen images 380 is displayed in display window 205. After the lastimage is displayed, the cine display module 387 may continue to displayimages at the requested frame rate starting again at the first image(i.e., a loop playback). In some instances, the zero-client webapplication 110 may perform a yo-yo playback, where the images aredisplayed from image 1 to n, then shown in reverse order from image n to1. In some instances, the zero-client web application 110 may stopplayback upon reaching the last image of a requested image series.

In some embodiments, the user may specify the amount of memory that maybe used by the zero-client web application 110 to store web browsercompatible images 370 and 415. For instance, the user may specify thememory space available to the zero-client web application 110 using theGUI 150, similar to the technique for the user to specify a frame rateusing the frame rate selector 190. Alternatively, the user may specifythe memory space available using a preferences window/screen of the GUI(not shown). If a requested image series requires more memory space thanspecified by the user, the zero-client web application 110 may skipimage frames in the playback of the requested image series (for example,it may only request and display every third frame) or may use a rollingwindow in memory. In the rolling window implementation, when the memoryavailable to the zero-client web application 110 has been filled, thezero-client web application 110 overwrites previously received webbrowser compatible images 370 and 415 with subsequently received webbrowser compatible images 415. For example, if memory capacity is filledwhen storing a PNG image associated with element (i+50) of the array ofoff-screen image 380, the zero-client web application 110 stores thenext PNG image for element (i+51) at the location in memory where thePNG image for element (i) is stored. In other words, the (i+51) imageoverwrites the (i) image. Thereafter, the (i+52) image will overwritethe (i+1) image, the (i+53) image will overwrite the (i+2) image, and soforth. In this example, no more than fifty-one PNG images occupy thelocal memory at one time.

FIG. 7 illustrates a method 500 for the web server 115 to handle arequest from a zero-client web application 110 for medical images storedin an incompatible format. In step 505, the HTTP request handler 325 ofthe server 115 receives the HTTP request 362 or 395 for an image fromthe zero-client web application 110. In step 510, the HTTP requesthandler 325 generates a DICOM image request 340 or 405. The DICOM imagerequest 340 or 405 is sent to the image server 125. The image database130 of the image server 125 receives the DICOM image request 340 or 405and provides the requested DICOM image 345 or 410 to the web server 115.In step 515, the DICOM image 345 or 410 is received by the imagerendering module 335 of the web server 115. In step 520, the imagerendering module 335 converts the DICOM image 345 or 410 into the webbrowser compatible image 370 or 415. In step 525, the image renderingmodule 335 outputs the web browser compatible image 370 or 415 to theHTTP request handler 325, which outputs the web browser compatible image370 or 415 to the zero-client web application 110.

Although the zero-client web application 110 has been described asproviding the ability to remotely view medical images, the zero-clientweb application 110 includes additional functionality in someembodiments. For example, a user may annotate medical images shown onthe display 205, zoom in/out on the medical images shown on the display205, associate text (e.g., a user description, comment, and/or medicalopinion) with the medical image series or medical images shown on thedisplay 205, and/or send or forward (e.g., via email) to other entitiesthe medical image series or medical images shown on the display 205.Additional operations a user can implement via the zero-client webapplication 110 include: adjust contrast, adjust brightness, zoomin/out, pan, rotate, grey-scale inversion, display of cross-referencelines, mirror, textual annotations, various line and angle measurementannotations, print, share with other users, and transfer to otherstorage devices.

Additionally, although the system 100 is described as for use withremotely viewing DICOM images stored in image database 130, other thesystem 100 may also be used for retrieving other file types. Forinstance, the system 100 may further be used for remote viewing of JPEG,PNG, TIFF, and BMP images. Additionally, the system 100 may also be usedfor remote viewing of DICOM structured reports and clinical documentarchitecture (CDA) documents.

Thus, embodiments of the invention provide, among other things, systemsand methods for remote cine viewing of medical images on a zero-clientweb application.

What is claimed is:
 1. A method of viewing medical images on a remotedevice using a zero-client web application, the method comprising:receiving image requests from a client device, at a web server, based onan image series selection received by the client device executing azero-client web application, requesting, from a medical image databasestoring images in a non-web browser compatible format, medical images inresponse to the image requests; converting, by the web server, themedical images to a web browser compatible format to generate convertedmedical images; sending, by the web server, the converted medical imagesto the client device, wherein the client device is configured topopulate an off-screen image array with the converted medical imagessent by the web server, and stream the converted medical images on thezero-client web application using the off-screen image array.
 2. Themethod of claim 1, further comprising: sending series details from theweb server that define the off-screen image array.
 3. The method ofclaim 1, wherein the client device is further configured to: determine abandwidth of a connection between the zero-client web application andthe web server; determine a sustainable streaming rate based on thebandwidth; receive, from the user, a requested streaming rate via thezero-client web application; and during a buffering stage, stream theconverted medical images at a frame rate that is the lower of therequested streaming rate and a percentage of the sustainable streamingrate.
 4. The method of claim 3, wherein the client device is furtherconfigured to: determine that the web server has completed sending theconverted medical images in response to the image series request; andstream the converted medical images at the requested streaming rate. 5.The method of claim 1, wherein streaming the converted medical imagescomprises: setting a first medical image within the off-screen imagearray as an on-screen image to display the first medical image; settinga next medical image from the off-screen image array as the on-screenimage to display the next medical image in place of the first medicalimage; and sequentially setting subsequent medical images of theoff-screen image array as the on-screen image to stream the medicalimages.
 6. The method of claim 5, wherein setting the next medical imagefrom the off-screen image array as the on-screen image includes settinga src attribute of the on-screen image to a src attribute of the nextmedical image.
 7. The method of claim 1, further comprising: receiving,from the client device, viewer parameters including a window size thatindicates a size of a display window of the zero-client web application;and formatting, by the web server, the converted medical imagesaccording to the viewing parameters.
 8. The method of claim 1, whereinthe web browser compatible format is one of Portable Network Graphics(PNG) and Joint Photographic Experts Group (JPEG) and the non-webbrowser compatible format is Digital Imaging and Communications inMedicine (DICOM).
 9. A web server for providing medical images forviewing on a zero-client web application, the web server comprising: amemory; a network connection to a client device executing a zero-clientweb application; a database connection to a medical image databasestoring images in a non-web browser compatible format; and a processor,the processor configured to: receive image requests from a client devicebased on an image series selection received by the client deviceexecuting the zero-client web application, request, from the medicalimage database over the database connection, medical images in responseto the image requests; convert the medical images to a web browsercompatible format to generate converted medical images; send theconverted medical images to the client device over the networkconnection, wherein the client device is configured to populate anoff-screen image array with the converted medical images sent by the webserver, and stream the converted medical images on the zero-client webapplication using the off-screen image array.
 10. The web server ofclaim 9, the processor further configured to: send series details, tothe client device, that define the off-screen image array.
 11. The webserver of claim 9, wherein the client device is further configured to:determine a bandwidth of a connection between the zero-client webapplication and the web server; determine a sustainable streaming ratebased on the bandwidth; receive, from the user, a requested streamingrate via the zero-client web application; and during a buffering stage,stream the converted medical images at a frame rate that is the lower ofthe requested streaming rate and a percentage of the sustainablestreaming rate.
 12. The web server of claim 11, wherein the clientdevice is further configured to: determine that the web server hascompleted sending the converted medical images in response to the imageseries request; and stream the converted medical images at the requestedstreaming rate.
 13. The web server of claim 9, wherein streaming theconverted medical images comprises: setting a first medical image withinthe off-screen image array as an on-screen image to display the firstmedical image; setting a next medical image from the off-screen imagearray as the on-screen image to display the next medical image in placeof the first medical image; and sequentially setting subsequent medicalimages of the off-screen image array as the on-screen image to streamthe medical images.
 14. The web server of claim 13, wherein setting thenext medical image from the off-screen image array as the on-screenimage includes setting a src attribute of the on-screen image to a srcattribute of the next medical image.
 15. The web server of claim 9, theprocessor further configured to: receive, from the client device, viewerparameters including a window size that indicates a size of a displaywindow of the zero-client web application; and format the convertedmedical images according to the viewing parameters.
 16. The web serverof claim 9, wherein the web browser compatible format is one of PortableNetwork Graphics (PNG) and Joint Photographic Experts Group (JPEG) andthe non-web browser compatible format is Digital Imaging andCommunications in Medicine (DICOM).
 17. A method of viewing medicalimages on a remote device using a zero-client web application, themethod comprising: establishing, by the web server, a connection with azero-client web application executing on a client device; receiving, bythe web server, image requests from the client device based on an imageseries selection received by the client device, providing, by the webserver, series details to the client device, the series details definingan off-screen image array; requesting, from a medical image databasestoring images in a non-web browser compatible format, medical images inresponse to the image requests; converting, by the web server, themedical images to a web browser compatible format to generate convertedmedical images; sending, by the web server, the converted medical imagesto the client device, wherein the client device is configured topopulate the off-screen image array with the converted medical imagessent by the web server; display a first medical image from theoff-screen image array as an on-screen image to display the firstmedical image; display a next medical image from the off-screen imagearray as the on-screen image in place of the first medical image; andsequentially display subsequent medical images of the off-screen imagearray as the on-screen image to stream the medical images.
 18. Themethod of claim 17, wherein the client device is further configured to:determine a bandwidth of the connection between the zero-client webapplication and the web server; determine a sustainable streaming ratebased on the bandwidth; receive, from the user, a requested streamingrate via the zero-client web application; and during a buffering stage,stream the medical images at a frame rate that is the lower of therequested streaming rate and a percentage of the sustainable streamingrate.
 19. The method of claim 17, further comprising receiving, from theclient device, viewer parameters including a window size that indicatesa size of a display window of the zero-client web application; andformatting, by the web server, the converted medical images according tothe viewing parameters.
 20. The method of claim 17, wherein the medicalimage database includes images stored in Digital Imaging andCommunications in Medicine (DICOM) format.